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In a questionnaire survey designed at the University of Toledo to determine the 
ranking of criteria of effective teaching, faculty, students and alumni New Mexco 
State University agreed that being well prepared for class was the most im P° r,a ™ 
criterion. This ranking was upheld by 10 subgroups of faculty (^Ity by years of 
service teaching or administrative, and faculty by colleges), except for the College o 
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When criteria used in the faculty merit rating was compared to criteria used m the 
questionnaire, it was found that 4 criteria ranked m the top 10 in the survey do not 
appear m the Merit Rating Form, whereas 4 listed m the bottom 10 of the survey do. 
suggesting that the Form should be redesigned. The same pattern of discrepancy and 
,md«d need for change was evident when the questionnaire was compared with the 
University's most widely used student evaluation form. Patterns of rankings - u 99 e - , < 
that teaching faculty are being evaluated according to a different :«fe y 
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List of Tables (Abbreviated tables) 

These tables show the rankings of teaching criteria by different subgroups. 



1. Top ten criteria rankings. 

2. Selected criteria( lowest 50 for faculty)rankings . 

3. Criteria used in faculty evaluation. 



4. 



5. 



6 . 



7. 
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9. 



10 . 



11 . 



12 . 



13. 



Top ten 
Top ten 
Top ten 
Top ten 
Top ten 
Top ten 
Top ten 
Top ten 
Ranking 
Ranking 



criteria ranked by administrative and non-administrative faculty. 

criteria ranked by faculty with varying yrs . of service at N.M.S.U. 

criteria ranked by students of varying grade point average. 

criteria ranked by various "types" of students. 

criteria ranked by faculty in each college. 

criteria ranked by students in different colleges. 

criteria ranked by alumni for each college. 

criteria ranked by College of Arts and Sciences. 

of top ten criteria by College of Agric. and Home Economics. 

of top ten criteria by College of Business Admin. & Economics. 



14. Ranking of top ten criteria by Co Liege of Education. 

15. Ranking of top ten criteria by College of Engineering. 

16. Ranking of top ten criteria by Graduate School. 

16B. Summary of rank correlation coefficients displayed in tables 

8a, 9a, 10a, 11a, 12a, 13a, 14a, 15a, 16a(between all N.M.S.U. 
and various subgroups in colleges) and sample sizes. 



17. Ranking of criteria used in student evaluation. 



There are tables with a suffix "A" for tables 2, and 4-16. These 
tables show the rank correlation coefficients for subgroups examined 
in the previous tables. 



i i 



















1. introduction j 

In Fall 1967, New Mexico State University participated in a 
survey to determine the ranking of criteria of teaching effective- 
ness. Other institutions that participated in this survey were 
the Universities of Northern Illinois and Western Kentucky. The 
University of Toledo conceived and developed the original design 
and implemented the earlier phase of the study. This was done 
under the direction of Richard R. Perry, Director of Institutional 
Research, University of Toledo. 

The research design of this survey is described below follbwed 
by the results. 

There are plans to extend this survey to other institutions 
in the United States and Canada. The data for New Mexico State 
University survey will then be correlated with these other insti- 
tutions. The results will be distributed to all those interested. 

It is expected that this phase of the study will be completed by 
early next year. 

Since this report is rather long, some readers may wish to turn 
to the "Summary and Conclusions" chapter at the end of the report. j 
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2. RESEARCH DESIGN 



2 . 1 Questionnaire Design 

A questionnaire was designed by the Office of Institutional 
Studies at the University of Toledo. It was field-tested at 
Toledo and then used in the survey in which New Mexico State 
University participated. 

2.2 Sample Design 

This survey sampled three main groups in the university 
community: faculty (teaching and administrative), students, 

and alumni. Of the faculty, all were sent questionnaires. 

One hundred and eighty-six out of 387 responded (48%) . From 
among the student body in the Fall of 1967, a random sample of 
1,400 students were sent questionnaires, of which two hundred 
and eighty-three responded (20. 2%) . From the alumni, a random 
sample of 700 were sent questionnaires, of which one hundred 

and eighty-five responded (26 .4%) 

The number of responses by each subgroup of the population 
was examined for its adequacy. The responses of some subgroups 
were considered unrepresentative and hence excluded from the 
analysis. The graduate faculty is such a case. The poor response 
here resulted from an inadequate questionnaire design which did 
not allow faculty to indicate more than one college . Consequent- 
ly, faculty that are not exclusively in the Graduate School did 
identify themselves with an undergraduate college and hence the 
response from the Graduate School in the sample was inadequate. 
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of the frequency of occurrence of a criteria and its weight gave 
a raw score total. This provided the basis of ranking of the 
criteria. Such rankings for various groups and subgroups were 
computed along with rank order correlation coefficients between 
various groups and subgroups. Most of this data is presented below. 

In cases of ties between the raw scores, the ranking was 
averaged. For example, if three raw scores tied for ranks 6,7, 
and 8, then each was given a rank of seven. If two raw scores 
tied for the ranks one and two, then they were each ranked as 1.5. 
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3. PRESENTATION OF FINDINGS 
3. 1 Tables Presented 

For the samples in each group (faculty, students, and alumni) 
the ranking is presented for all the criteria listed in the question- 
naire. Also, the rank correlation coefficients for these three 
groups is presented. For subgroups (administrative and non-administrative 
faculty, faculty by years of service, students by grade point average, 
by location of home, by status of transference to N.M.S.U., and faculty, 
staff, and students by college), the ranking is shown for at least 
the top ten criteria as perceived by each of the three groups (faculty , 
students, and alumni). The ranking of the other criteria and the rank 
correlation coefficients for different combinations of subgroups are 
not presented in this study in order to save space, 
is available and can be studied by persons interested. 

Rank correlation coefficients are shown for all subgroups with 
all N.M.S.U. (faculty , students, and alumni). They have been rounded 
to three significant digits. The detailed computations have been 
made correct to six significant digits and are available to interested 

persons . 

The questions as entered in the tables are sometime abbreviated 
in order to economize typing and space. For the detailed wording 
of the criteria in the questionnaire, see Appendix A. 



The sum of subtotals do not always equal the totals in groups 
because some codes for subgroups are missing. 
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3 . 2 SYMBOLS USED 



A&s College of Arts & Sciences 

BA&E College of Bus. Admin. & Economics 

AGRIC College of Agric. & Home Economics 

EPUC College of Education 

ENGR College of Engineering 

GRAD Graduate School 

GPA Grade Point Average 

NMSU. . . New Mexico State University 



^ less than -i.e.^2 means less than 2 
^ greater than-i.e.^3 means greater than 3 
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4. FINDINGS OF THE STUDY 
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4. I Correlations 

The correlations between different groups and subgroups at 
New Mexico State University were all found to be significant at 
the 0.01 level . 



The correlation between all the institutions surveyed 
(in both the original survey at the University of Toledo and 
the latter study in which New Mexico State University participated) 



was found to be well above the correlation required 
ficance. The rank correlation coefficients between 
academic community (faculty , students, and alumni) o 
institutions in the survey are as follows: 

N. M. S. U. with University of Toledo 

N.'M. S. U. with Northern Illinois University 

N. M. S. U. with Western Kentucky University 



for signi- 
the entire 
f the four 



=0.982 

=0.977 

=0,952 



The rank correlation coefficient between the subgroups for 
each university are not shown here but the computations are 



available for interested persons. 
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PRIORITY OF IMPORTANCE OF TOP TEN CRITERIA FOR EFFECTIVE 
TEACHING AS PERCEIVED BY FACULTY, STUDENTS, AND ALUMNI. 



CRITERIA 



Being well prepared for class 
Establishing sincere Interest in tho subj. taught 
Motivating students to do their best 
Encouraging Intelligent Independent thought by stud, 
Icommunicating effectively at levels appropriate 
(Treating students with respect 



/sing teaching methods which enable students to 
aehleve 



>ing fair & reasonable to students in evaluation 
[procedures. 



(Demonstrating comprehensive knowledge of his subj. 



Icons trusting test which search for understanding on 
Ithe part of the stud, rather than rote memory ability 



Organizing the course in logical fashion 



Acknowledging all questions to the best of his 
lability 



Being able to show practical applications of 
subject matter. 



Sample Size 



• Faculty 


i 

'Student 8 


i 

f Alumni 


; * 
' N.M.S.U. 


1.0 

\ 

j 


* 

i 

i 

i i.o 

i 


1.0 


; 10 


2.0 


3.o ; 

i 


2.0 

I 


♦ 

2.0 


3.0 


13.0 i 

1 

12.0 ; 


11.0 

\ 


11.0 


4.0 


l 

4.0 


j 5.o 


5.0 


7.0 


10.0 


7.0 


6.0 


11.0 


7.0 


10.0 


7.0 


8.0 


9.0 


9.0 


8.0 


2.0 


6.0 


3.0 


9.0 


4.0 

i 


| 5.0 

; i 


6.0 

i 


10.0 


1 

5.5 


1 

3.0 

1 


1 

| 4.0 


11.0 


5.5 


1 

1 80 

i 


I 

> 

8.0 

i 

[ 


12.0 


9.5 


i 

13.0 I 

I 

1 


12.0 

1 


21.0 


9.5 


12.0 


13.0 


186 


283 


185 


654 



*This includes all faculty, students, and alumni in the sample. 
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COMMENTS ON TABLE 1 

1. There are only 13 criteria that are listed in the top ten 
most important criteria by at least one of the three groups. 

2. The only criteria on which all three groups of faculty, 
student, and alumni agree is that of "being well prepared 
for class." This was ranked by all groups as the most 
important criteria of effective teaching. 
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PRIORITY OF IMPORTANCE OF SELECTED CRITERIA (LOWEST 50 FOR FACULTY) 
FOR EFFECTIVE TEACHING AS PERCEIVED BY FACULTY, STUDENTS, AND ALUMNI, 



ppttprta 1 


FACULTY ! 


t 

STUDENTS » 


ALUMNI 


N.M.S .1 


\j n x i iin am — 

Setting high standards of achievement for stud. 


r 

13.0 


f 

21. 5 


20.0 


18.0 


Raising the aspirational level of students 


14.0 


26.0 


15.5 ; 

* 
t 


19.0 


Being able to show practical appl. of subj. matter 


15.0 

; 


9-5 


12.0 i 


13.0 


Rewriting and updating tests 


15.0 \ 

i 

i 


15.0 


15.5 


15.0 


Establishing good rapport with stud, in classroom 


16.5 J 


20.0 


19.0 


17.0 


Being readily avail, for consultation with stud. 


16.5 1 


14.0 | 


14.0 


14.0 


Patiently assisting stud, with their problems 


18 -° ! 


17.0 j 

l 


17.0 


16.0 


Accepting justified constructive criticism by 


1 

19.0 1 


21.5 i 


O 

Cvl 


22.0 


qualified persons 


t 






Recognize the responsibility for the acad. success j 


O 

O 

OJ 


19.0 

1 


25.O 


! 21.0 


of students ] 
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i 






, • i 

» 

Encouraging student participation in class 


« 

22.0 \ 29.5 

! 


j 24.0 


25.0 


Iden. his comments which are personal opinion 


23.0 


29.5 ! 

i 


! 31.0 

[ 


28.0 


Providing sev. test opportunities for students 


24.0 


1 

25.0 ; 

i 


| 34.0 

i 

t 


27.0 


Having practical experience in his field 


25.0 


16.0 


18.0 


20.0 


Evidencing better than average speech qualities 


26.0 


23.0 


29.0 

1 


26.0 


Seldom using sarcasm with students 


27.0 


i 37.0 


37.0 


34.0 


■ Encouraging moral responsibility in stud, by his ex 


. 28.0 


38.0 


30.0 


32.0 


Engaging in cont. formal study in his field 


29.0 


24.0 


22.0 


12.0 


Making written comments on corrected returned assig 


;. 30.0 


18.0 


21.0 


22.5 


Returning graded assignments promptly 


31.0 


32.0 


26.0 


30.0 
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CRITERIA 


FACULTY 


STUDENTS 


ALUMNI J 


N.M.S.U. 


Relating course material to that of other courses 


32.0 


33.0 


28.0 j 


31.0 ; 


I Using more than 1 type of evaluation device 


33.0 | 


28.0 


27.0 


! 29 .O ! 

5 


| Making an effort to kno stud, as individuals 


34.0 I 

j 


40.0 


39-0 


O O 

VO OJ 

* 


I Exhibiting a genuine sense of humor 


35.° j 


| 41.0 


47.0 


I Explaining grading standards 


36.0 \ 


1 39-0 


43.5 


\ 

40.0 j 

\ 

41.0 | 


I Displaying broad intellectual interests 


37-0 


42.0 


38.0 


I Indication that the scope & demands of each assign. 
| have been considered carefully 


38.0 | 


1 

| 31.0 


35.0 


4 

1 

33.0 | 


(Exhibiting an intelligent personal phil. of life 


39-0 j 


49.0 


43.5 


46.0 i 


(Explaining grading procedures 


40.0 j 


! 34.0 


1 

' 41.5 


37.0 


(Presenting organized supp. course material to stud. a 


41.0 i 


1 45.0 


36.0 


43.0 i 


| Challenging students convictions ' 


42.0 ] 


J 43.0 j 

I 

36.0 j 

| 1 


I 40.0 


44.0 i 


I Demonstrating a stable level-headed personality 


43.0 


[ 33.0 1 

1 

; 41.5 


1 i 

x 35.0 j 

! < 


J Earning the respect of his colleagues 


44.0 


, 47.0 ! 


1 « 
45.0 1 


I Announcing tests and quizzes in advance 


45.0 


27.0 


j 48.0 


, $ 
39.0 i 

4 


inspiring stud, to continue to graduate study 


46.0 


52.0 


!. 51.0 


i 

52.0 j 


(Taking measures to prevent cheating by students 


47.0 


350 


32.0 

1 


1 

38.0 i 

: 


I Utilizing visual aids to assist in creating subj. 
J matter achievement with students 


48.0 


! 48.0 


46.0 


\ 

47.0 i 


j Sharing departamental duties with his colleagues 


48.0 


50.0 


52.0 


» 

50.0 j 


1 Beginning and ending classes on time 


50.0 


46.0 


49.0 


48.0 | 


I Being neatly dressed 


51.0 


51.0 


50.0 


51.0 j 
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TABE 2 continued 
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CRITERIA 



Having irritating personal mannerisms 



Holding membership in scholarly organization 



Publishing material related to his subject field 



Presenting an ext. lucid syl. of the course to stud, 



Being consistently involved in research projects 



Being knowledgeable about the community in which 
he lives 



Devoting time to student activities on campus 



Involving himself in appropriate univ. comm. 



Making appearances which assist programs of 
community organizations 



FACULTY 



52.0 



54.0 



55.0 

56.0 



57.0 



STUDENTS 



ALUMNI 



54.0 



53.0 j 57.0 



59.0 



44.0 

55.0 



58.0 } 



59.0 



53.0 

58.0 

56.0 



60.0 \ 60.0 






54.0 

55.0 

58.0 

45.0 

57.0 



53.0 

59-0 

5M 



60.0 



N.M.S.U. { 



I I 




57.0 
3.0 

56.0 



54.0 

59.0 

58.0 



60.0 



53.0 •) 



I 



55.° J 



} 
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NOTES ON TABLE 2 



1. Table 2 is a continuation of Table 1 and shows the ranking 
of criteria not included in Table 1. 



1 . 



2 . 



COMMENTS ON TABLE 



2 



i 



The criterion of "publishing material related to his subject" 
was ranked as 54, 59, and 58of the most important (out of 60 
criteria) by faculty, students, and alumni respectively. 

The criterion of "making appearances which assist programs 
of community organizations" was ranked as the least important 
criteria of effective teaching by all three groups of faculty, 
students, and alumni. 



RANK CORRELATION COEFFICIENTS FOR GROUPS EXAMINED IN TABLE 1 & 2 . 

Faculty with alumni =0.952 
Faculty with students =0.935 
Students with alumni =0.965 
Faculty with all N.M.S.U* =0.972 

Students with all N.M.S.U.* =0.985 

Alumni with all N.M.S.U.* =0.986 



^Includes all three groups in the sample-faculty, students 
and alumni. 
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TABLE 3 



PRIORITY OF IMPORTANCE OF CRITERIA FOR EFFECTIVE 
TEACHING USED IN FACULTY EVALUATION* AS PERCEIVED BY 
FACULTY, STUDENTS, AND ALUMNI. 



Faculty 



Students 



Alumni 



Teaching 

Attitude toward student 



Knowledge of Subject matter 
Organization of Material 

Presentation of Material 

I Attitude towards teaching 



Research for Creative Scholarship 
iPreparat ion (Academic) 



(Planning and execution 

Results (Publication) 

irection of Graduate Students 
Professional Service 



Service with Students 
Committee work(Dept. Coll.&Univ) 

Off-campus Professional Work 



Q. 19 
Q. 22 
q. 33 
Q. 39 
Q. 47 
Q. 54 

Q. 20 

Q. 44 
Q. 35 

Q. 10 
Q. 17 

Q. 16 
Q. 48 



Q. 9 
Q. 4 

Q 24. 

Q. 8 



Q. 30 
Q. 25 
Q. 37 



46.0 

22.0 
18.0 
16.5 

4.0 

38.0 

9.0 

11.0 

1.0 

7.0 

16.5 

41.0 

7.0 



25.0 

29.0 

19.0 

54.0 



58.0 

49.0 

59.0 



52.0 

29.5 

17.0 

14.0 

12.0 

31.0 

4.0 

29.5 

1.0 

7.0 

20.0 

45.0 

8.0 



16.0 

24.0 

21.5 

59.0 



58.0 

50.0 
56 .0 



*See Manual, Explanation of Merit Rating Systjem , New ^lexico State University, 
Dated September 1, 1967 ' 



51.0 

24.0 

17.0 

14.0 

4.0 

35.0 

5.0 

8.0 
1.0 

10.0 

19.0 

36.0 
9.0 



18.0 

22.0 

23.0 

58.0 



59.0 

52.0 
56.0 
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Notes on Table 3 

1. The criteria used in the survey questionnaire are not the 

same as used in the Merit Rating at New Mexico State University. 
The criteria in the questionnaire that seem most related 
to the Merit Rating items are identified by the number of 
the question on the questionnaire for each item used in 
Merit Rating. 

2. The criteria of "Direction of Graduate Study" and "Off-Campus 
Professional Work" on the Merit Rating Form are not listed 

on the questionnaire and hence appear blank in the ranking 
table. 
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TABLE 4 



PRIORITY OF IMPORTANCE OF TOP TEN CRITERIA FOR EFFECTIVE 
TEACHING AS PERCEIVED BY ADMINISTRATIVE, NON-ADMINISTRATIVE 
FACULTY. 



CRITERIA 



Being well prepared for class 

Establishing sincere interest in the subj. taught 
Motivating students to do their best 
Encouraging intelligent independent thought by stud. 
I Communicating effectively at levels appropriate 
iTreating studcntfe with respect 



fslng teaching methods which enable students to 
achieve 



iing fair & reasonable to students in evaluation 
[procedures. 



Demonstrating comprehensive knowledge of his subj. 



(Constructing test which search for understanding on 
the part of the stud, rather than rote memory ability 



Organizing the course in logical fashion 



icknowledglng all questions to the best of his 
i ability 



Being able to show practical applications of 
subject matter. 



Sample Size 



| ADMIN.- 


: NON 

ADMIN ! 


1.0 


1.0 


5.0 


2.0 


3.0 


3.0 


4.0 


4.0 


2.0 


7.0 


6.0 


5.0 


9.0 


6.0 


7.0 


8.0 


8.0 


9.0 


10.0 


10.0 


50 


149 
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RANK CORRELATION COEFFICIENTS FOR SUBGROUPS EXAMINED IN TABLE 4 

Administrative faculty with non -administrative faculty =0.928 

Administrative faculty with all New Mexico State Univ. =0.915 

i 

Non-administrative faculty with all New Mexico State Univ. =0.974 j 

COMMENTS ON TABLE 4A 

The non-administrative faculty (i.e. teaching faculty) has a j 

higher rank correlation coefficient with the New Mexico State 1 

University community than does the administrative faculty. j 

1 

•1 
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— TABLE 5 


PRIORITY OF IMPORTANCE OF TOP TEN CRITERIA FOR EFFECTIVE 
TEACHING AS PERCEIVED BY FACULTY WITH VARYING YEARS OF 
SERVICE AT NEW MEXICO STATE UNIVERSITY. 


CRITERIA 


! i-io 


>10-20 ' 


[>20 j 


Being well prepared for class 


1.0 


1.0 


1.0 


Establishing sincere interest in the subj. taught 


2.0 


4.0 


2.5 


Motivating students to do their best 


3.0 


2.5 


5.5 


I Encouraging intelligent independent thought by stud. 


4.0 


2.5 


9.0 


Communicating effectively at levels appropriate 


5.0 


8.5 


5.5 


Treating students with respect 


7.0 


5.5 


11.0 


using teaching methods which enable students to 
1 achieve 


6.0 


8.5 


12.5 


Being fair & reasonable to students in evaluation 
I procedures. 


8.0 


1 

j 

10.0 i 

i 


1 

f 

8.0 


Demonstrating comprehensive knowledge of his subj. 


9.0 


i 

5.5 


10.0 


Constructing test which search for understanding on 
Ithe part of the stud, rather than rote memory ability 


12.0 


i 

7.0 


5.5 


Organizing the course in logical fashion 


11.0 


12.0 


2.5 


Acknowledging all questions to the best of his 
ability 


10.0 


14.5 


15.5 


IBeing able to show practical applications of 
Isubject matter. 








I Encouraging intelligent independent thought 
by students 


4.0 


2.5 


9.0 


1 

Setting high standards of achievement for i 

students 


16.0 


13.0 


5.5 


Sample Size 


111 


52 


27 


• 
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COMMENTS ON TABLE 5 



The criteria ranking by faculty varies as the years of service 
change . The consistent changes are that the importance of "using 
teaching methods which enable students to achieve objective of the 
course" is less important to the older groups. Also, the importance 
of "constructive tests and "setting high standards" increases with 
years of service. (Generation gap?) 

SELECTED RANK CORRELATION COEFFICIENTS FOR SUBGROUPS EXAMINED IN TABLE 5 
Faculty with 1-10 years of service and all N.M.S.U. =0.969 

Faculty with 10-20 years of service and all N.M.S.U. =0.959 

Faculty with more than 20 years of service and all N.M.S.U. =0.894 
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TABLE 6 


PRIORITY OF IMPORTANCE OF TOP TEN CRITERIA FOR EFFECTIVE 
TEACHING AS PERCEIVED BY STUDENTS OF VARYING G.P.A. 


CRITERIA 


GPAsO-2 


GP^2-3 


| GPA> 3 


Being well prepared for class 


1.0 


3.0 


1.0 


I Establishing sincere interest in the subj. taught 


5.5 


5.5 


4.5 | 


I Motivating students to do their best 








1 Encouraging intelligent independent thought by stud. 






8.5 


Communicating effectively at levels appropriate 


9.5 


1.0 


10.0 j 


ITreatlng students with respect 


9.5 




7.0 t 


M®iug teaching methods wh?ch enable students to 
I achieve 




7.0 


8.5 


Being fair A reasonable to students in evaluation 
I procedures. 


2.0 


2.0 


6.0 


1 Demonstrating comprehensive knowledge of his subj. 


7.0 


4.0 


4.5 


(Constructing test which search for understanding on 
Ithe part of the stud, rather than rote memory ability 


8.0 


1 

8.5 i 

i 


2.0 


Organizing the course in logical fashion 


5.5 


10.0 


3.0 


Acknowledging all questions to the best of his 
1 ability 


4.0 


8.5 




Being able to show practical applications of 
I subject matter. 


3.0 


5.5 




1 Sample Size 


42 


12U 


115 
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NOTES ON TABLE 6 



1. Only the criteria ranked as top ten by each group of faculty, students, 
and alumni are shown in Table 6. The blanks can be filled in by the 
interested reader by referring to Tables 1 and 2. 

This method has been adopted(in this tables and some other tables 
that follow) in an attempt not to clutter the table with less important 



SELECTED RANK CORRELATION COEFFICIENTS FOR SUBGROUPS EXAMINED IN TABLE 6 



rankings . 



TABLE 6A 



Student with 0-2 GPA and all N.M.S.U. =0.927 



Student with>2-3 GPA and all N.M.S.U. =0.960 



Student with>3 GPA and all N.M.S.U. =0.981 
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PRIORITY OF IMPORTANCE OF TOP TEN CRITERIA FOR EFFECTIVE 
TEACHING FOR VARIOUS "TYPES" OF STUDENTS 



CRITERIA 



i Live in 
Dorm 



Being well prepared for class 



Establishing sincere interest in the subj. taught 



Motivating students to do their best 



Encouraging intelligent independent thought by stud. 



Communicating effectively at levels appropriate 



Treating students with respect 



i/slng teaching methods which enable students to 
achieve 



teing fair & reasonable to students in evaluation 
procedures. 



Demonstrating comprehensive knowledge of his subj. 



Constructing test which search for understanding on 
the part of the stud, rather than rote memory ability 



Organizing the course in logical fashion 



Vcknowledglng all questions to the best of his 
ability 



Being able to show practical applications of 
subject matter. 



Commuter ? at r NSsu a | Trans fei 



2.0 



3.0 



10.5 

7.0 

8.0 



1.0 



4.0 

9.0 



5.0 

10.5 



6.0 



Sample Size 



86 



1.0 

4.0 



10.0 

6.5 



8.0 



1.0 

3.0 



8.0 



10.0 



2.0 



2.0 



6.5 

3.0 



5.0 

9.0 



4.0 

5.0 



8.0 



8.0 



194 ' 162 
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1.0 

7.0 



10.0 



2.0 

9.0 



8.0 



3.0 



4.0 



6.0 



6.0 • 5.0 



117 



i 
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COMMENTS ON TABLE 7 






"Motivating students to do their best" was ranked third by all faculty 
but is not ranked in the top ten by any student group (those who live in 
dorms, are commuters, are registered originally at New Mexico State 
University, or those who transferred to New Mexico State University.) 

TABLE 7A 

SELECTED RANK CORRELATION COEFFICIENTS FOR SUBGROUPS EXAMINED IN TABLE 7 

Commuter student with dormitory student =0,960 

Student starting at N.M.S.U. with transfer student =0.948 ] 
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COMMENTS ON TABLE 8 

All faculty subgroups in the colleges, except the College of Education, 
ranked the criterion "being well prepared for class" as the most 
important criterion. The faculty in the College of Education ranked 
this criterion as 6.5 and ranked "motivating students to do their 
best" as the most important criterion. 

SELECTED RANK CORRELATION COEFFICIENTS FOR SUBGROUPS EXAMINED IN TABLE 8 

Faculty in College of Arts & Sciences with all N.M.S.U. =0.949 

Faculty in College of Agric. & Home Econ. with all N.M.S.U. =0.936 

Faculty in College of Bus. Admin. & Econ. with all N.M.S.U. =0.810 

Faculty in College of Education with all N.M.S.U. =0.833 

Faculty in College of Engineering with all N.M.S.U. =0.910 
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TABLE 9 
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TABLE 9A 



SELECTED* RANK CORRELATION COEFFICIENTS FOR SUBGROUPS EXAMINED IN TABLE 9 



Students in College of Arts & Sciences with all N.M.S.U. 



Students in College of Ag. & Home Econ. with all N.M.S.U. 
Students in College of Bus. Admin. & Econ. with all N.M.S.U, 



Students in College of Education with all N.M.S.U. 



Students in College of Engineering with all N.M.S.U, 
Students in Graduate School with all N.M.S.U. 



= 0.971 
= 0.948 
= 0.935 
= 0.931 
= 0.934 
= 0.951 



*Rank correlations between the students of the different colleges and 
other subgroups in the university have not been shown because of space 
limitations. All correlation coefficients are available to those 
interested. 
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PRIORITY OF IMPORTANCE OF TOP TEN CRITERIA FOR EFFECTIVE 
TEACHING AS PERCEIVED BY ALUMNI FOR EACH COLLEGE. 




• 


CRITERIA 


1 i 

A&S 


A&HE 


[ 

!ba&e 


EDUC ‘ 


en6r 


GRAD 


Patiently assisting stud, with their problems 

Being readily available for consultation 
with students 




9.0 


T 

t 

i 


9.5 






JclriQ well prepared for class 


1.0 


1.5 


1.0 


1.0 


1.0 


i.o 

i 


Establishing sincere interest in subj. taught 


2.0 


1.5 


2.5 


7,0 


7.5 


5.0 


.Motivating students to do their best 




7.5 








3.0 


Encouraging intelligent independent thought by stud. 


3.5 


7.5 


' 7.0 


9.5 


7.5 


3.0 


Communicating effectively at levels appropriate 


8.0 

i 




i 


3.0 


10.5 


9.5 


Treating students with respect 


5.5 


4.5 


9.5 


6.0 






Using teaching methods which enable stud, to 
achieve objectives of the course 






9.5 


3.0 


iO.5 


6.0 


Being fair and reasonable to stud, in evaluation 
I procedures 


8.0 


4.5 


4.5 


9.5 


5.5 


9 . 5 r 


Demonstrating comprehensive knowledge of his subj. 


5.5 




4.5 


3.0 


2.0 


8.0 


Constructing test which search for understanding on 
the part of the stud, rather than rote memory ability. 


3.5 


4.5 




5.0 


3.0 


3.0 


Organizing the course in logical fashion 


8.0 




7.0 




5.5 


7 . 0 1 


Acknowledging all questions to the best of his ability. 1 


10.0 






9.5 


9.0 




Being able to show practical appl. of subj. matter. 




4.5 


2.5 




4.0 




Identifying his comments which are personal opinion 














Establishing good rapport with stud, in classroom 








1 

i 






Setting high standards of achievement for stud. 

Rewriting and updating tests 






7.0 


i 






Sample Size 


39 


23 


\ 15 


22 


1 58 


27 



27 
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TABLE 11 



PRIORITY OF IMPORTANCE OF TOP TEN CRITERIA FOR EFFECTIVE 
TEACHING AS PERCEIVED BY FACULTY, STUDENTS AND ALUMNI IN 
COLLEGE OF ARTS & SCIENCES. 



1 CRITERIA | Faculty ' 


Students 


Alumni 


Being well prepared for class 


1.0 


1.0 


1.0 


Establishing sincere interest in the subj. taught 


3.0 


5.5 


2.0 


I Motivating students to do their best 


4.0 


13.5 


11.0 


Encouraging intelligent independent thought by stud. 


2.0 


5.5 


3.5 


1 Communicating effectively at levels appropriate 


5.0 


9.5 


8.0 


iTreating students with respect 


9.0 


12.0 


5.5 


Using teaching methods which enable students to 
1 achieve 


6.5 


11.0 


16.5 


Being fair & reasonable to students in evaluation 
(procedures. 


11.5 


2.0 


8.0 


Demonstrating comprehensive knowledge of his subj. 


8.0 


3.0 


5.5 


(Constructing test which search for understanding on 


ft s 


l n 


O C 


(the part of the stud, rather than rote memory ability 




#u 


i • J 


Organizing the course in logical fashion 


11.5 


8.0 


8.0 


Acknowledging all questions to the best of his 
ability 


10.0 


7.0 


10.0 


Being able to show practical applications of 
1 subject matter. 






1 


1 Sample Size 


. 88 


50 


39 



















TABLE 11A 

SELECTED RANK CORRELATION COEFFICIENTS FOR SUBGROUPS EXAMINED IN TABLE 11 



Faculty in College of Arts & Sciences with all N.M.S.U. = 0.949 
Students in College of Arts & Sciences with all N.M.S.U. = 0.971 
Alumni in College of Arts & Sciences with all N.M.S.U. ■ 0.951 



TABLE 12 



PRIORITY OF IMPORTANCE OF TOP TEN CRITERIA FOR EFFECTIVE 
TEACHING AS PERCEIVED BY FACULTY, STUDENTS, AND ALUMNI IN 
THE COLLEGE OF AGRICULTURE & HOME ECONOMICS. 



CRITERIA 



FACULTY 



Being well prepared for class 

Establishing sincere interest in the subj. taught 

Motivating students to do their best 

Encouraging intelligent independent thought by stud, 

[Communicating effectively at levels appropriate 

[Treating students with respect 

Using teaching methods which enable students to 
achieve 

3eing fair & reasonable to students in evaluation 
procedures. 

Demonstrating comprehensive knowledge of his subj. 

Constructing test which search for understanding on 
the part of the stud, rather than rote memory ability 

Organizing the course in logical fashion 

Acknowledging all questions to the best of his 
ability 

Being able to show practical applications of 
subject matter. 

Rewriting and updating tests 

Being' readily available for consultation 
with students 



1.0 

3.0 

2.0 

6.5 

6.5 

5.0 

4.0 

8.5 

12.0 

18.0 

8.5 

18.0 

15.5 

12.0 

12.0 



J 

STUDENTS 



4.0 

3.0 

18.5 
7.5 

5.0 

6.0 

11.5 

1.0 

7.5 

13.0 
11.5 

10.0 

2.0 

9.0 

15.0 



Sample Size 



38 



38 



ALUMNI 

1.5 

1.5 

7.5 

7.5 

15.0 

4.5 

12.0 

4.5 

20.5 

4.5 

12.0 

29.0 

4.5 

20.5 

9.0 

23 
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TABLE 12A 



i 



SELECTED RANK CORRELATION COEFFICIENTS WITH ALL N 



.M.S.U. AND SUBGROUPS EXAMINED IN TABLE 12 
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TABLE 13 



PRIORITY OF IMPORTANCE OF TOP TEN CRITERIA FOR EFFECTIVE 
TEACHING AS PERCEIVED BY FACULTY, STUDENTS, AND ALUMNI 
IN THE COLLEGE OF BUSINESS ADMINISTRATION & ECONOMICS 


1 CRITERIA I 

! FACULTY 


; j 

STUDENT! 


1 1 

: ALUMNI 


Being well prepared for class 


j 1.0 


7.0 


1.0 


Establishing sincere interest in the subj. taught 


5.5 


1.5 ! 

1 


; i 

2.5 1 

i 


Motivating students to do their best 


5.5 


j 

15.0 


15.5 j 

t 


1 Encouraging intelligent independent thought by stud. 


15.0 


12.0 


7.0 j 

i 


Communicating effectively at levels appropriate 


15.0 


9.0 


.5., 


{Treating students with respect 


2.5 


10.5 


9.5 


using teaching methods which enable students to 
1 achieve 


5.5 


7.0 | 

1 i 


9.5 j 


Being fair & reasonable to students in evaluation 
(procedures. 


2.5 


i 

I 

i j 

3.5 j 


4.5 


Demonstrating comprehensive knowledge of his subj. 


15.0 


i 

5.0 ! 


4.5 


(Constructing test which search for understanding on 
(the part of the stud, rather than rote memory ability 


9.5 


i 

i 

3.5 j 

i 

1 


11.0 

> 

1 


Organizing the course in logical fashion 


5.5 


i 

1.5 I 


7.0 


\cknowledging all questions to the best of his 
ability 


24.5 


10.5 


18.0 


Being able to show practical applications of 
subject matter. 


20.5 


7.0 

i 

l 


2.5 

1 

1 


Rewriting and updating tests 


15.0 


18.0 


7.0 


! Sample Size 


7 


48 


15 



33 







M 









TABLE 13A 

SELECTED RANK CORRELATION COEFFICIENTS FOR ALL N.M.S.U. AND SUBGROUPS EXAMINED IN TABLE 13 

Faculty in College of Business Administration & Economics -0.810 
Students in College of Business Administration & Economics -0.935 
Alumni in College of Business Administration & Economics -0.935 
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TABLE 14 



PRIORITY OF IMPORTANCE OF TOP TEN CRITERIA FOR EFFECTIVE 
TEACHING AS PERCEIVED BY FACULTY, STUDENTS, AND ALUMNI 
IN THE COLLEGE OF EDUCATION. 



CRITERIA 


FACULTY 


STUDENTS 


ALUMNI 


I Being well prepared for class 


6.5 


1.0 


1.0 


I Establishing sincere interest in the subj. taught 


6.5 


9.0 


7.0 


I Motivating students to do their best 


1.0 


4.0 


12.5 


1 Encouraging intelligent independent thought by stud. 


4.0 


13.5 


9.5 


I Communicating effectively at levels appropriate 


2.5 


3.0 


3.0 


(Treating students with respect 


9.5 


2.0 


6.0 


using teaching methods which enable students to 


11.5 


11.5 


3.0 


I achieve 




Being fair & reasonable to students in evaluation 
1 procedures. 


6.5 


6.0 


• 

9.5 


(Demonstrating comprehensive knowledge of his subj. 


2.5 


7.0 


3.0 


(Constructing test which search for understanding on 


9.5 


5.0 


5.0 


Ithe part of the stud, rather than rote memory ability 


Organizing the course in logical fashion 


26.5 


9.0 


15.0 


Acknowledging all questions to the best of his 


26.5 






ability 


9.0 


9.5 


iBelng able to show practical applications of 


26.5 


13.5 


20.0 


1 subject matter. 


(Rewriting and updating tests 


17.0 


17.0 


15.0 


IPatiently assisting stud, with their problems 


33.5 


18.0 


9.5 


I Seldom using sarcasm with students 


6.5 


29.0 


47.0 


1 Sample Size 


17 


37 


22 



35 













TABLE 14A 

SELECTED RANK CORRELATION COEFFICIENTS WITH ALL N.M.S.U. AND SUBGROUPS EXAMINED IN TABLE 14 



Faculty in College of Education with all N.M.S.U. =0.833 
Students in College of Education with all N.M.S.U. =0.931 
Alumni in College of Education with all N.M.S.U. =0.940 
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TABLE 15 



PRIORITY OF IMPORTANCE OF TOP TEN CRITERIA FOR EFFECTIVE 
TEACHING AS PERCEIVED BY FACULTY, STUDENTS, AND ALUMNI 
IN THE COLLEGE OF ENGINEERING. 



CRITERIA 

Being well prepared for class 

Establishing sincere Interest In the subj. taught 

I Motivating students to do their best 

I Encouraging Intelligent Independent thought by stud. 

| Communicating effectively at levels appropriate 

resting students with respect 

Tslng teaching methods which enable students to 
achieve 

»lng fair & reasonable to students In evaluation 
procedures. 

(Demonstrating comprehensive knowledge of his subj. 

(Constructing test which search for understanding on 
jth® Part of the stud, rather than rote memory ability 

)rganl2lng the course In logical fashion 

Acknowledging all questions to the best of his 
ability 

Being able to show practical applications of 
| subject matter. 

Rewriting and updating tests 
Sample Sise 



FACULTY t STUDENTS ' ALUMNI 



1.0 


1.0 


1.0 


2.5 


I 9.0 


7.5 


5.0 


20.0 


12.5 


10.0 


12.0 


7.5 


7.0 


7.0 


10.5 


2.5 


19.0 


12.5 


13.0 


6.0 


10.5 


4.0 


2.0 


5.5 


13.0 


4.5 


2.0 


15.0 


8.0 


3.0 


7.0 


3.0 


5.5 


18.5 


10.0 


9.0 


10.0 


4.5 


4.0 


7.0 


11.0 


14.0 


26 | 


~~57 


58 
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TABLE 15A 

SELECTED RANK CORRELATION COEFFICIENTS FOR SUBGROUPS EXAMINED IN TABLE 15 

Faculty in College of Engineering with all N.M.S.U. = 0.910 
Student in College of Engineering with all N.M.S.U. = 0.934 
Alumni in College of Engineering with all N.M.S.U. = 0.961 
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TABLE 16 



PRIORITY OF IMPORTANCE OF TOP TEN CRITERIA FOR EFFECTIVE 
TEACHING AS PERCEIVED BY STUDENTS AND ALUMNI IN THE 
GRADUATE SCHOOL. 
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CRITERIA 


STUDENTS 


ALUMNI 


I Being well prepared for class 


1.0 


1.0 


I Establishing sincere interest in the subj. taught 


4.0 


5.0 


Motivating students to do their best 


4.0 


3.0 


Encouraging intelligent independent thought toy stud. 


10.5 


3.0 


Communicating effectively at levels appropriate 


8.0 


9.5 


[Treating students with respect 


2.0 


11.0 


Using teaching methods which enable students to 
I achieve 


10.5 


6.0 


Being fair & reasonable to students in evaluation 
I procedures. 


7.0 


9.5 


remonstrating comprehensive knowledge of his subj. 


9.0 


8.0 


(Constructing test which search for understanding on 
the part of the stud, rather than rote memory ability 


4.0 


3.0 


Organizing the course in logical fashion 


6.0 


7.0 


Acknowledging all questions to the best of his 
I ability 


12.0 


15.0 


Being able to show practical applications of 
[subject matter. 


16.0 


20.5 


1 Sample Size 


52 


27 



1 
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TABLE 16A 



SELECTED RANK CORRELATION COEFFICIENTS FOR SUBGROUPS EXAMINED IN TABLE 16 



Students in Graduate College with all N.M.S.U. = 0.951 
Alumni in Graduate College with all N.M.S.U. = 0.942 
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TABLE 16B 

SUMMARY OF RANK CORRELATION COEFFICIENTS DISPLAYED IN TABLES 8A, 9A, 
LOA, LIA, I2A, I3A, 14A, 15A, and I 6 A. (BETWEEN ALL N.M.S.U. AND VARIOUS 
SUBGROUPS IN COLLEGES) AND SAMPLE SIZES 



GROUP 


A&S 


A&HE 


BA&E 


EDUC 


ENGR 


GRAD 


FACULTY 


0.949 

(88) 


0.936 

(38) 


0.810 

(7) 


0.833 

(17) 


0.910 

(26) 




STUDENTS 


0.971 

(50) 


0.948 

(38) 


0.935 

(48) 


0.931 

(37) 


0.934 

(57) 


0.951 

(52) 


ALUMNI 


0.951 

(39) 


0.907 

(23) 


0.935 

(15) 


0.940 

(22) 


0.961 

(58) 


0.942 

(27) 



Note: Sample Size is shown in parenthesis. 






; 




















COMMENTS ON TABLE 16B 

1. Among th« Coll«f«s, two groups in the College of Arts & Sciences 

(faculty and students)have the highest rank correlation coefficient 
with all New Mexico State University. The alumni of the College of 
Arts & Sciences has the second highest rank correlation coefficient 
among the colleges . (Engineering has the highest). 

2. Amongst the faculty, the College of Business Administration and 
Economics has the lowest rank correlation coefficient with all 
New Mexico State University. 

3. Amongst the students, the College of Education has the lowest 
rank correlation coefficient with all New Mexico State University. 

4. Amongst the alumni, the College of Agriculture & Home Economics 

has the lowest rank correlation coefficient with all New Mexico 
State University. 
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TABLE 17 



PRIORITY OF IMPORTANCE OF CRITERIA FOR EFFECTIVE TEACHING 
USED IN STUDENT EVALUATION* AS PERCEIVED BY FACULTY. STUDENTS 
AND ALUMNI * 



FACULTY 



STUDENT 



ALUMNI 



Teachers apparent familiarity with subject 

Q. 20 

| Teachers ability to convey his know, of sub 

q. 10 

|Teachers ability to stimulate interest 

Q. 6 

| Teachers apparent attitude toward subject 

Q.27 

[Teachers apparent attitude towards stud. 

Q. 18 
Q. 33 
Q. 39 
Q. 41 

[Teachers impartiality in grading 

Q. 55 

moying mannerisms in the teacher 

Q. 26 

Organization of the course 

Q. 44 



See appendix B. for copy of Student Evaluation She at most often used a: N.M.S.l 



57.0 

40.0 

14.0 

11.0 
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SUMMARY AND CONCLUSIONS 



There is considerable variation among the ranking of the criteria 



State University. There is, however, unanimity amonqst all throe 
groups that the nost important criterion is "being well prepared for 
class." This rankinq was upheld by the ten subnroups of faculty 
(faculty by years of service, teaching or administrative, and faculty 
by colleges) except for the faculty of the College of Education. The 
faculty in the Col lone of Education ranked "motivating students to do 
their best" as the nost important criterion. 

A criterion concerning research, that of "publishing material 
related to his sujcct field" was ranked low by the three groups. 
Faculty ranked this criterion as 54, students as 59, and alumni as 
the 58 most importer criterion. Another research related 
criterion, "being consistently involved in research projects,” was 
ranked 56, 55, and 57 by faculty, students, and alumni. 

These rankings clearly means that the .'«/•*. S.'J. communi+y feels that 
publishing in one's field and being involved in research projects is 
not important for effective teaching. Criteria concerned with 

i 

off-campus community relations were also ranked low by all three 
groups :f faculty, students, and alumni. The criterion of "being 
know I edgeab I e about the community in which he I ives" was ranked as 
57,53, and 53 by faculty, students, and alumni respectively. 

The criterion of "making appearances which assist programs of community 
organizations," was ranked unanimously as being least important by each 
group of faculty, staff, and students. 

The criteria used in faculty merit ratine were comoared with 
the criteria uso*d in the study questionnaire. No criterion was worded 
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identically, but there were many criteria in the questionnaire that 
were related to those used in faculty merit rating. The ranking of 
these criteria(Table 3) indicate that there are four criteria ranked 
in the top ten by the N.M.S.U. community that do not appear explicitly 
in the Merit Rating Form(questions 2, 27, 4, and 55 on the question- 
naire). On the other hand, four criteria listed in the bottom ten 
by the N.M.S.U. community do appear on the Merit Rating Form(questions 
8, 19, 30, and 37). This suggests that the Merit Rating criteria 
used for evaluatina effective teaching should be redesigned assuming 
that it is used for evaluating effective teaching. The quesionnaire 
study can help in such a redesign and also in assigning weights to 
each of the criteria used for merit rating. 

The ranking of criteria by the administrative faculty was 
different from the rankings by the teaching faculty(see Table 4). 

This implies that teaching faculty are being evaluated(by adminis- 
trative faculty) according to a ranking scale different from their 
own. This implication may be important when one considers that the 
ranking of the teaching faculty has a higher rank order correlation 
coefficient with the N.M.S.U. community than does the administrative 
faculty. (See Table 4) 

The ranking by subgroups of faculty by years of service, and 
by subgroups of students do indicate some interesting results but 
no important pattern emerges. The ranking by subgroups of faculty, 
students, and alumni within colleges identify some interesting and 
significant divergencies between colleges and could be of interest 
for discussions by col lege faculties. 

Comparing the questionnaire criteria with the criteria used on 
the most commonly used student evaluation form at N.M.S.U., it appears 
that many of the criteria ranked high by the N.M.S.U. community and 
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the students themselves do no* appear on the Student Evaluation Form. 
Of the top ten criteria as ranked by students in the survey, five do 
not appear on the Student Evaluation Form. Of the top ten criteria 
as ranked by faculty, four do not appear on the Student Evaluation 
Form. This implies that if the Student Evaluation Form is to reflect 
the ranking priorities of the students for the faculty(whom it is 
allegedly designed to help) then the present Student Evaluation Form 
should be redesigned. 

In conclusion, it should be stated that this study does identify 
attitudes concerning teaching effectiveness. It should provide a 
basis of discussion which should lead to a design of an instrument 
that would better identify the variables involved. If this instru- 
ment is a questionnaire, then an attempt should be made to take a 
larger sample and use techniques of factor analysis and discrimi- 
nant analysis in analysing the results. 

Meanwhile, as suggested above, it is hoped that this study 
would provide a basis of discussion between groups in administration, 
among faculty, and between the faculty and the administration. The 
topic of criteria of effective teaching could well be the subject of 
a one or two day seminar in which resource speakers are followed by 
group discussions between the teaching faculty and the administration. 
This dialogue could be useful not only in better articulating the 
criteria, their significance and how they could be achieved, but it 
would also improve the communication between faculty and adminis- 
tration. Such a seminar could not only help teaching faculty at 
N.M.S.U. to be more effective teachers, but could also lead to 
more oquitable and satisfactory procedures of faculty evaluation. A 
recent study at N.M.S.U. showed that only 577» of the faculty at 
N.M.S.U. considered the ability of their dean to "evaluate faculty 
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performance fairly" as being adequate or excellent. Only 46% stated 
that their dean "lets you know your standing in relation to how your 
work is evaluated" as adequate or excellent/ This percentage could 
perhaps be increased by a seminar or some similar discussion. This 
in turn would lead to a better communication on our organizational 
goals concerning teaching and a better understanding of the means 
of achieving them. The seminar could also include student represen- 
tatives, thereby , improving the communication between students and 
faculty. 

*See Peterson, B.O., A Study of Faculty Attitudes at Two State 

Supported Universities . 

(Doctoral dissertation at N.M.S.U., 1968) 
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Please list annoying mannerisms if present:. 



